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Abstract 

We describe an expansion of Legendre polynomials, analogous to the Taylor expansion, to approximate 
arbitrary functions. We show that the polynomial coefficients in Legendre expansion, thus, the whole series, 
converge to zero much more rapidly compared to the Taylor expansion of the same order. Furthermore, using 
numerical analysis with sixth-order polynomial expansion, we demonstrate that the Legendre polynomial 
approximation yields an error at least an order of magnitude smaller than the analogous Taylor series 
approximation. This strongly suggests that Legendre expansions, instead of Taylor expansions, should be 
used when global accuracy is important. 
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1. Introduction 

The question whether and how a given function can be expressed approximately by polynomials are of 
great importance in theory as well as in practice. For example, by definition, an explicit, finite formula is 
unavailable for transcendental functions, and instead, an appropriate polynomial approximation is chosen 
to replace the function. Because polynomials, particularly the ones of low order, are easy to manipulate, 
this approach provides computational speed with minimal penalty in accuracy. 

A natural candidate for polynomial approximation is a truncated Taylor expansion, typically at the 
midpoint of the interval where the approximation is most accurate. Taylor's theorem and the Weierstrass 
approximation theorem [l[ asserts the possibility of local approximation of an arbitrary function y{x). More- 
over, the approximation accuracy improves as the degree of the polynomial increases. However, this im- 
provement comes at the expense of complexity and computational speed. This expense can be substantially 
reduced if the function can be approximated to the same accuracy with a lower degree polynomial. 

Here, we show analytically that an arbitrary function can be approximated via Legendre polynomials 
using non-uniformly spaced points on an interval as the input, and that at least for some functions, approx- 
imation with Legendre polynomials yields a substantially higher accuracy and faster convergence compared 
to Taylor expansion of the same order (i.e., with the same number of non-zero coefficients). We further 
demonstrate the improvement in accuracy over Taylor expansion numerically, using the sine, exponential, 
and entropy functions. 

2. Theory 

Consider the problem of estimating the instantaneous slope of the curve mapping the the output of the 
function y(x) to x G [a, b]. The formula for the slope in a linear regression y{x) ~ x + e for uniformly spaced 
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continuous points x over the interval [a, b] is given by 
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where E(x) denotes the expectation of x. Because x is uniform in [a, 6], the denominator of the equation [T] 
can be written as 
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where a 2 a b ^ is the variance in the interval [a, b]. The numerator of the equation [T] can be written as 
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which can be solved using integration by parts: 
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where y' = dv }^ ■ Plugging equations [5] and [6] into equation [3j equation |4] can be written as 
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Finally, combining equations [7] and [3J equation Q] can be rewritten as 
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which is just an average with respect to a quadratic kernel that is centered at the midpoint of the interval 
[a, b] and zero at the ends. Equation [3] allows estimation of the instantaneous slope over not just the points 
that are uniformly spaced, but all points in the interval [a, b]. 

This result for estimation of the slope is far more general. It provides a least squares polynomial 
approximation to an arbitrary function on the interval [a, b]. To see this, consider the shifted Legendre 
polynomials of order n, defined by Rodrigues' Formula [2j, |3j: 
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where 8 nm denotes the Kronecker delta, equal to 1 if m = n and to otherwise. Furthermore, Legendre 
polynomials of order 1 to n are the same as the orthogonal polynomials obtained by the Gram-Schmidt 
process on the polynomials {1, x, x 2 , . . . } with respect to the inner product given by equation 1101 up to a 
constant multiplication factor [2, 3]. Therefore, by adding the basis functions l,x, ... ,x n , we obtain the 
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order polynomial fit to an arbitrary function y on the interval [a, b] as 
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41 By completing the sum of squares, the expected integrated squared residual error for equation [TT] can be 

42 written as 
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The term 
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in equation [TT] has a simple and telling interpretation. Note that 
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which follows from equation [9] The integral in equation [14] can be solved using integration by parts, and 
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none of the boundary terms appear in the solution because — - — (x — a) n (x — b) n — for x = a,b and 
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k = 0, • • • n — 1. Moreover, 
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where /3(a, 6; c, d) is a beta probability distribution with (a, b) degrees of freedom, shifted and scaled so that 
it lies on the interval [c, rf], and ^( n +i,n+i;a,6)( - ) is the expected value with respect to this distribution. 
Therefore, the contribution of each of the n th — order Legendre polynomial to the residual error for eauation llll 
(shown in equation 1121) can be rewritten as 
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Equation [TB] is analogous to the Taylor expansion, and uses a scaled value of the expected value of the 
n th derivative in the expansion. Note that the distribution j3(n + 1, n + 1; a, b) is a parabola raised to the 
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power and scaled to integrate to 1, so it rapidly approximates 



of the distribution f2 ~ /3(a, b; c, d) is given by 
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and the entire series (equation [TT]) takes the form 
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The series in equation 1191 converges much more rapidly than the Taylor series because the coefficient 
( — 1)™/ ( 2 ™)n\ converges to zero much more rapidly than the analogous term 1/n! in Taylor series. Further- 
more, if \d n y / dx n \ < Ka n for arbitrary constants K and a, it is easy to show (by Stirling's formula and by 
the nature of Legendre functions) that the squared norm of the n th term is bounded above by 
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Note that the multiplier of the numerator, but not that of the denominator, of equation 1201 is bounded. 
Let T no denote the first term of the series in equation 1191 If we choose its order, no, such that rig > 
a 2 e 2 (b — a) 2 /8, then the squared norm of each successive term Tk+ no has a norm 



for hq + k > no- This shows that the sum of squares of the terms after the n$ term is at most twice 
the size of the previous term, and the series is dominated by a geometric sequence with a decay constant 
1 /2. Because one can start with any arbitrary n > no, the upper bound of the absolute value of n th term 
(equation [20]) can be reduced arbitrarily by simply increasing the number of terms, n. 

Demonstrating convergence in absolute value is also simple because the Legendre polynomials are nor- 
malized so that they are bounded by one. The bound, equivalent to that in equation 1201 for the maximum 
of the n th term is given as: 
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This bound also indicates that for the same no (as above), the maximum norm of each successive term is 
again less than 2~ k max(T„ ). Similar to above, for large no, the absolute value of the terms n > no is less 
than twice the absolute value of the term no, which can be arbitrarily small. Thus, the Legendre Polynomial 
expansion converges at a very rapid rate. 



3. Numerical Results 



There is no simple computable remainder (corresponding to the one in Taylor series expansion) in 
Legendre polynomial approximation, but only bounds (see above). Therefore, we demonstrate the im- 
provement in accuracy via an empirical approach using three representative transcendental functions: the 
sine function (sin(27re)), the exponential function (exp(x)), and the entropy of a Bernoulli trial (H(p) = 
—plogp — (l—p) log(l —p)) in the interval [0,1]. Note that all three functions satisfy the boundedness con- 
dition \d n y / dx n \ < Ka n above. For comparison, we approximate the functions with Taylor and Legendre 
polynomials using at most six non-zero coefficients (Figured]). Because the sine function has odd symmetry 
about x = 1/2 and the entropy function H(p) is odd, the expansions of these function involve, respectively, 
polynomial degrees of 11 and 10 of even and odd order. We estimate the signal-to-noise ratio (SNR, in 
decibels) for approximations as 

SNR(/, /) = 10 log 10 j° P (23) 
Jo (/ - f) 

to quantify the accuracy in approximation (Table [T]). 
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Figure 1: Taylor and Legendre polynomial approximations at x £ [0, 1] Dashed red traces show the actual function evaluated for 
each x. Values of polynomial approximations are shown with solid traces, and successively darker colors indicate approximations 
using one (light-gray) to six (black) non-zero polynomial coefficients. 



Consistent with the theoretical considerations in above, these results show a rapid convergence of Leg- 
endre polynomials for increasing number of polynomial coefficients, and an improved accuracy compared 
to Taylor polynomials of the same order. Note that using six coefficients, even the least improvement (in 



Table 1: Signal-to-noise ratios (in decibels) for the Taylor (T) and Legendre (L) polynomial approximations. Note the higher 
SNR for the Legendre polynomial approximation. The accuracy of Legendre polynomial approximation is significantly greater 
than that of Taylor approximation of equal order. 
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89 the case of the exponential function) is 21.59 decibels (which amounts to an average error for the Legendre 

90 approximation 0.087 times the error for the Taylor approximation). The approximation for the sine function 

91 leads to an improvement of 63.18 decibels (that is, the error the Legendre approximation is 0.0007 times as 

92 that for the Taylor approximation on average) . Note in Figure [T] that while the Taylor polynomial approx- 

93 imation has maximum accuracy at the midpoint, Legendre polynomial approximation distributes the error 

94 more uniformly throughout the entire interval. As a result, the squared error of is smaller and the SNR is 

95 larger in case of Legendre polynomials. 

96 4. Conclusions 

97 Our analytical and numerical results show that Legendre polynomials can substantially improve the 

98 speed and accuracy of function approximation compared to Taylor polynomials of the same order. The 

99 fast convergence of Legendre polynomials was noted in a prior study [4|, but the geometric convergence 

100 in norm has not been shown analytically before. The geometric convergence rate is consistent with the 

101 general result of Srivastava [B| on the relation of the generalized rate of growth of an entire function to the 

102 rate of uniform convergence of a polynomial approximation on an arbitrary infinite compact set. And, it 

103 should be noted that the geometric convergence is not possible in general for L p approximants if p =/= 2 

104 Thus, approximation using Legendre polynomials can provide significant performance improvements in 

105 practical applications. We also showed that Legendre polynomials has the additional advantage that an 
loe arbitrary function can be approximated using non-uniformly spaced points on a given interval. Importantly, 
107 its accuracy of approximation is substantially higher than that of the Taylor expansion with the same order 
los of polynomials, with a uniform error distribution across the entire interval. Therefore, Legendre expansion, 
109 instead of Taylor expansion, should be used when global accuracy is important. 
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